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MIXTURE  RESOLVING  SIGNAL  PROCESSING 


% 

1.  THEORY  - Professor  Wm.  D.  Gregg,  Claude  Feistel  and  Joseph  Kozuh, 

Ken  Culp,  Computer  Programmer 
Research  activity  in  the  area  of  communication  theory  and 

systems  pertinent  to  signal  detection,  filtering  and  parametric  informa- 

1,  10 

tion  extraction  is  in  progress.  The  major  effort  is  concerned  with 

the  conception,  definition,  study,  development  and  interpretation  as 
well  as  application  of  techniques  relevant  to  the  solution  of  signal  mixtures 
composed  of  information  and  external  channel  impairment  effects  typical 
of  communications/radar/sonar  environments.  Theoretical  research 


has  been  primarily  concerned  with  the  task  of  performing  measurements 

upon  incoming  signal  mixtures  in  order  to  extract  required  parametric 

data  for  optimum  processing  of  the  available  signal  in  a detection  or 

extraction  context.  Approaches  and  techniques  currently  under  investi- 
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gation  consist  of  formal  mixture  decision  theory,  * M1*1  order  statis- 

2 3 7 

tical  measurements,  ’ ’ and  conventional  and  optimized  decision  directed 
1»  4 

estimation.'  In  the  overall  measurement  effort,  the  goal  has  been  to 
derive  a relatively  noise-free  signal  detection/classification/discrimination 


reference.  Rather  broad  analytical  activity  in  progress  has  been  directed 

2 3 6 7 

toward  the  concept  of  moment  estimation  * ' ' in  discriminant  function 


synthesis  and  mixed  series  resolution.  The  incoming  data  models  allow 


for  the  consideration  of  non-Gaussian  as  well  as  Gaussian  statistics. 


Properties  of  mixture  resolving  estimators  currently  being  studied  and 
evaluated  consist  of  measurement  bias,  mean- square  estimation  error, 
measurement  variance,  and  related  measures  of  convergence  as  a function 


of  observation  data  available  for  processing  as  well  as  a measure  of 
"signal"  field  intensity  to  "noise"  field  intensity. 


2 


In  addition,  discrete  signal  processing  algorithms  are  being 

developed  and  digital  computer  programs  extended  in  order  to  further 

Monte  Carlo  experimental  case  studies.  The  theoretical  development 

is  aimed  at  the  goal  of  formulating  analytical  results  for  optimal  mixture 

resolving  signal  and  data  processing  structures  requisite  to  the  tasks 

involved  in  optimum  channel  identification,  phase  coherent  and  matched 

filter  detection,  target  and  cross  section  identification/discrimination/ 

$ 

classification,  and  multi-function  range,  doppler,  and  coordinate  resolu- 
tion, etc. 

In  particular,  two  classes  of  mixture  resolving  estimators  have 

been  treated  and  compared:  1)  a uniformly  weighted  decision-directed 

2 

estimator,  and  2)  an  M1"  order  moment  estimator.  The  estimator 
formulation  was  developed  under  the  conditions  of  no  a priori  classification 
of  the  incoming  signal  mixture  observations  into  isolated  data  populations, 
and  no  a priori  knowledge  of  the  mixture  population  parameters  representing 
the  noise  covariance  and  signal  waveforms  was  assumed. 

Monte  Carlo  experimental  studies  of  convergence  properties  for 
the  binary  case  were  carried  out  via  digital  computer  simulation.  The 
principal  results,  observations,  and  conclusions  arc  as  follows:  1)  the 
M^  order  moment  measurement  algorithm  converges  at  a rate  higher  than 
that  of  the  uniformly  weighted  decision-directed  algorithm;  2)  the  M1^  order 


moment  measurement  algorithm  developed  in  this  work  is  bounded  from 


above  by  the  uniformly  weighted  decision-directed  algorithm  near 
threshold  signal-noise-ratio  conditions,  and  reasonably  approaches 
the  performance  of  the  Bayes  matched  filter.  The  latter  effect  is 
attributed  to  the  fact  that  moment  mixture  resolving  estimation,  as 
developed,  is  unbiased  whereas  uniformly  weighted  decision-directed  ■ 
mixture  resolving  estimation  contains  a signal-noise-ratio  dependent 
bias. 

The  significance  of  the  increased  convergence  rate  is  the  genera- 
tion of  a relatively  noise  free  detection  reference  in  shorter  time  pro- 
viding for  near  optimum  asymptotic  performance.  A comparison  of 
experimental  results  is  given  in  Fig.  11-9.  Further  quantitative  results 
will  be  presented  in  the  next  report. 

2.  EXPERIMENTAL  - Professor  Wm.  D.  Gregg,  Bill  Boverie, 

Jimmy  Hinton*^  and  Jimmy  Rogers 

The  abstract  and  theoretical  results  for  signal-mixture  resolution 
are  interpreted  into  physical  terms  for  purposes  of  exploiting  technological 
utility  in  terms  of  electronic  data  processing  implementation  for  the 
design  of  and  physical  experimentation  with  detection/cstimalion/resolution 
and  information  extraction  systems.  Analog  peripheral  and  special  purpose 
electronics  intended  for  the  processing  of  actual  signal  mixtures 
encountered  in  actual  communications/radar /sonar  environments  are 


implemented.  Experimental  research  is  aimed  at  a demonstration 
and  evaluation  of  the  stability  and  convergence  characteristics  of 
the  various  optimal  adaptive  and  learning  receiving-systems 


4 


theoretically  developed.  The  experirm  utation  laboratory  is  being  readied 
to  accomplish  near  physical  simulation  studies,  scaled  at  most  in  frequency, 
with  a portion  of  the  environment  of  actual  signal  mixtures  encountered, 
synthesized  in  the  analog  portion  of  the  peripheral  electronics  or  obtained 
from  a high  quality  data-tape-system  recording  of  actual  sensor  outputs 
in  the  field.  The  execution  of  complex  signal  processing  requirements 
will  be  carried  out  digitally.  Specific  instrumentation  and  peripheral 
preprocessing  has  been  set  up  and  tested  to  process  signal  mixture  data 
as  might  be  encountered  in  telemetry  or  radar /sonar  environment  char- 
acteristics of  angle  coded  modulation  with  a suppressed  reference,  conveyed 
over  a channel  with  selective  fading  and  angle  instability.  Electronic  pre- 
processing equipment  and  signal  conditioning  monitoring  instrumentation 
has  been  procured  in  part,  tested  and  integrated  into  the  system.  In  the 
radar/sonar  tapes  employing  various  forms  of  angle  diversity  coding,  the 
instrumentation  is  being  readied  to  adjust  the  post  tape  signal  processing 
center  frequencies,  bandwidths,  spectral  cutoff  characteristics,  conversion 
frequencies,  and  thresholds,  in  conjunction  with  the  cognitive  data  transfer. 

Quantitive  experimental  results  will  be  summarized  and  reported 
as  available. 
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Fig.  II- 9 Comparison  of  Experimental  Detector  Performance 
Characteristics. 
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RECEIVER  STRUCTURES  AND  PERFORMANCE  CHARACTERISTICS  OF  OPTIMIZED 
ARRAY  AND  DIVERSITY  RECEIVING  SYSTEMS,  Professor  W.  D.  Gregg  and 
J.  H.  Derryberry* 

The  multilink  array  or  space  diversity  receiver  structure  for  the  optimum  detec- 
tion of  incoming  time-varying  faded,  multipath  signals  in  an  additive  noise  masking 
environment  is  derived  from  the  maximum  likelihood  ratio.  This  analytical  result  and 
consequently  the  optimum  receiver  structure  is  directly  related  to  the  model  that  one 
chooses  for  the  channel  environment.  For  cases  in  which  the  channel  has  multiplicative 
fading  (random  channel  modulation),  additive  noise,  and  multipath  the  optimum  diver- 
sity receiver  consists  basically  of  a tapped  delay  line  estimator-correlator  computer. 
This  structure  has  been  developed  for  the  case  of  independent  fading  and  noise  multi- 
path  field 

For  problems  of  engineering  interest  in  communication/radar/and  sonar,  these 

fields  are  often  correlated,  both  between  and  within  the  multiple  channels  and  like- 

l 2 

wise  diversity  links.  ' A study  of  performance  characteristics  of  optimum  re- 
ceiver processors  yields  information  concerning  the  relative  merit  of  various  modu- 
lation formats,  combining  techniques,  and  array  structures. 

This  study  investigates  the  effect  of  cross-link  and  intra-link  correlation  of 
the  masking  fields,  of  the  array  structure,  and  of  the  combining  technique,  upon 
the  system  performance  for  a multipath  channel  model  with  diversity  reception 

in  which  there  are  correlated  fading  fields  and  correlated  additive  noise  fields. 

3 4 5 6 

Starting  with  the  development  of  Price  and  Green0'  and  Kailatn  and  ex- 
tending it  to  the  continuous  channel  model  one  arrives  at  the  optimum  continuous 
receiver  data  processor.  The  receiver  processor  consists  of  a bank  of  estimator- 


f 

2 

"auto-correlators"  and  estimator-" cross-correlators  " The  structure  of  each 
estimator  is  dependent  on  the  second  moment  statistical  nature  of  the  incident 
channel  processes.  The  test  statistic  computed  by  the  receiver,  thus  contains 
information  Lbout  the  incident  field  statistics  as  well  as  the  diversity  array 

i 

structure.  Trom  the  test  statistic  and  the  receiving  system  is  obtained  the 

I 

associated  probability  densities  and  the  resulting  system  performance  character- 
istic. By  examining  the  performance  characteristics  one  observes  the  effect  of 
the  correlation  of  the  random  fields  and  the  effect  of  the  array  structure  on  sys- 
tem performance.  With  this  knowledge  one  draws  conclusions  as  to  the  advan- 
tages  and  disadvantages  of  various  array  structures  (those  that  cause  the  input 
data  to  the  processor  to  be  correlated  between  links  and  those  that  cause  the 
link  processes  to  be  uncorrelated),  optimality  of  related  modulation  techniques 
(PSK,  FSK,  general  angle  coding),  and  various  combining  schemes  (sum,  weighted 
sum,  quadratic,  etc.) 

An  extension  of  the  discrete  case  to  the  continuous  case  follows  when  the 
discrete  filters  are  replaced  by  their  continuous  analog  versions.  Once  this 

is  done  continuous  analog  receiving  systems  can  be  investigated  for  the  nature  of 
a similar  set  of  combining,  array,  and  diversity  modulation  techniques,  thus 
enabling  one  to  design  and  implement  better,  more  accurate  communications/radar/ 
and  sonar  detection,  classification  and  discrimination  systems.  The  quantitative 


results  will  be  summarized  and  presented  in  the  next  report. 
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OPTIMIZATION  OF  THE  DETECTABILITY  OF  ARRAY  AND  DIVERSITY 

RECEIVING  SYSTEMS,  Professor  William  D.  Gregg  and  Robert  W.  Cline* 

% 

/ 

Optimum  array  and  diversity  reception  principles  and  detectability  char- 
1 2 

acteristics  ' are  being  studied  and  developed  to  establish  the  role  of  a priori 
information  requirements  and  detectability  gain  sensitivity  to  transmitter,  channel, 

i 

cross-section,  information  mismatches.  Initially,  the  detectability  characteristics 
of  a simple  one  sensor  element  were  examined  for  the  binary  signal  case."*  The 


probability  of  error,  p£,  a figure  of  performance  merit  for  likelihood  detectors  was 
derived  and  its  dependence  upon  signal  to  noise  ratio  for  various  values  of  binary 


signal  inter-correlation  coefficients  was  considered.  All  of  the  parameters  present 
in  pE  were  examined  with  respect  to  sensitivity  and  inter-relationships.  The  mo-del 
was  later  modified  to  include  the  effect  of  receiver  to  channel  mismatch  conditions. 

Proceeding  into  a more  realistic  and  physically  representative  problem  re- 
quires the  transition  from  the  discrete  case  to  the  continuous  case.  This  transi- 
tion requires  the  employment  of  orthogonal  expansions  such  as  the  Karhunen-Loeve 
4 

Expansion  and  related  applications  to  a wide  class  of  detection  problems.  In  the 
multiple  sensor  configuration,  the  role  of  the  dimensionality  of  the  link  upon  the 
test  statistic  is  being  enlarged  and  evaluated.  To  enhance  the  " signal-to-noise" 
ratio,  an  array  of  elements  is  being  considered. ^ The  number  of  elements, 


geometry  of  the  array  and  spatial  field  intensity  conditions  are  being  examined 
with  respect  to  their  effect  upon  the  overall  optimization  of  the  receiver.  Means  of 
enhancing  space,  time,  frequency  and  decision  diversities  are  of  related  interest. 


A figure  of  merit  equation  is  being  derived.  Other  factors  such  as  time- 
varying  fading,  correlation  between  elements  of  the  array  and  the  role  of  sensi- 
tivity to  a priori  information  requirements  are  included.  Based  on  the  assumption 
that  certain  array  sensor  output  spectral  properties  are  desirable,  from  an  optimum 
detection  Standpoint,  means  of  enhancing  them  by  variations  in  the  parameters  of 
the  array  (such  as  beam  steering),  etc.,  are  included  in  the  investigation.  The 
intent  of  Spatial  processing  is  to  establish  the  necessary  preliminary  processing 
for  the  purposes  of  enhancing  spatial  signal  to  noise  field  intensity  and  relative 
correlation  properties. 

Quantitative  results  will  be  summarized  and  presented  in  the  next  report. 
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OPTIMUM  DEMODULATION  AND  INFORMATION  EXTRACTION  FOR  CONTINUOUS 
TIME  FUNCTIONS  UNDER  BROAD  CHANNEL  IMPAIRMENT  CONDITIONS,  Professor 
William  D.  Gregg  and  Stephen  Lyons 

This  research  is  concerned  with  the  optimal  recovery  of  a continuous  message 
source,  a(t),  from  a masked  incident  signal,  r(t).  a(t)  may  be  con- 

tained in  the  carrier's  instantaneous  amplitude,  envelope,  angle,  frequency  or  some 
derivative  thereof.  Van  Trees  * has  investigated  the  problem  in  some  detail  for  the 
nonstationary  Gaussian  signal  source  when  the  carrier  is  subjected  to  a randomly  time 
varying  channel  with  additive  Gaussian  noise.  He  found  that  the  receiver  structure 
for  the  "maximum  likelihood"  estimator  requires  the  implementation  of  a generally 
unsoluable  integral  equation  which  he  interprets  as  a feedback  system  with  non- 
realizable  filters.  This  receiver  is  realized  arbitrarily  closely  by  the  addition  of  de- 
lay into  the  system. 

The  problem  has  been  extended  to  include  additional  masking  of  the  message 
source.  Prior  to  reaching  the  receiver  system  the  carrier  s(t,a(t))  may  be  subjected 
not  only  to  fading  and  additive  Gaussian  noise  but  also  to  frequency  and  phase  in- 
stability, deterministic  jamming  and  additive  impulsive  noise  (see  Fig.  II— 8) . For 
example  with  a phase  modulated  carrier 

s (t , a (t))  = V(t)  sin  (uu  t + a(t)), 

c 

The  incident  signal  r(t)  will  be  of  the  form 

r(t)  = Ab(t)  sin(uj  t + a(t)  + 0(t))  + n(t)  + J(t) 
c 

where 

b(t)  = fading  due  to  the  channel, 

0(t)  = phase,  frequency  instability,  doppler, 


n(t)  = Gaussian  and  impulsive  noise  effects,  and 
J(t)  = jamming  factor 


Current  research  activity  is  being  concentrated  upon  the  following  1)  development 

of  the  optimal  structure  for  angle  and  envelope  modulation  subjected  to  fading  and 

phase/frequency  instability;  evaluation  of  the  optimality  measure,  and  for  the  optimal 

2 

instantaneous  angle  and  envelope  extractor.  Determination  of  the  necessary  changes 
in  the  optimality  criterion  and  receiver  structure  when  unwanted  deterministic 
clutter  is  included  in  the  incoming  signal.  Establishment  of  the  effects  of  addi- 
tive impulsive  noise  upon  the  system  performance  and  necessary  system  changes 
to  compensate  for  it.  The  effects  of  phase  and  frequency  instability  upon  the 

estimation  of  a(t)  has  been  developed  as  a parallel  extension  of  the  work  of  Berger 
2 

and  Tufts  for  the  effects  of  jitter  upon  PAM  recovery. 

Quantitative  results  will  be  summarized  and  presented  in  the  next  report. 
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OPTIMAL  SIGNAL  DESIGN  FOR  FADING  INCOHERENT  CHANNELS, 
Professor  William  D.  Gregg  and  Albert  J.  Bern! 

The  optimization  of  linear  and 

non-linear  "chirp"  modulation  signals  for  digital  data  transmission  and  reception 

12  3 

over  aohereit  and  incoherent  channels  is  being  investigated.  ' ' A study  has 

been  made  of  existing  techniques  for  Joint  optimization  in  the  transmission  and 

4 5 

reception  of  signals  of  the  character  stated  above.  ' For  coherent  reception  in 
additive  noise,  the  antipodal  phase  shift  keyed  signal  sets  are  optimum.  When 
the  channel  impairments  are  complicated  with  multiplicative  fading  and  multipath, 
incoherent  reception  with  an  orthogonal  signal  set  such  as  frequency  shift  keying 
becomes  an  essential  consideration. 

Presently  being  investigated  is  a compromise  between  the  orthogonal  and 
antipodal  signal  sets  in  the  form  of  linear  and  nonlinear  FM'd  sets  such  as  slope 
shift  keying.  In  signals  of  this  nature  the  frequency  modulation  is  of  piecewise 
continuous  type  as  opposed  to  the  "instantaneous"  shifting  used  in  FSK,  PSK, 
etc.  Under  investigation  is  the  synthesis  of  an  optimum  "chirp"  like  signal  set 
to  modulate  the  frequency  in  an  R.F.  transmission  with  maximum  "antipodality." 
As  a first  attempt,  "piecewise  linear"  frequency  modulation  signals  are  being 
considered  and  extended  to  "quadratic"  frequency  modulat.  . functions. 

Quantitative  results  will  be  summarized  and  presented  in  the  next  report. 
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